Skip to content

memory_tests: update reporting#36413

Merged
dkrupnov merged 7 commits into
openvinotoolkit:masterfrom
culhatsker:memtest_add_model_source
Jul 13, 2026
Merged

memory_tests: update reporting#36413
dkrupnov merged 7 commits into
openvinotoolkit:masterfrom
culhatsker:memtest_add_model_source

Conversation

@culhatsker

Copy link
Copy Markdown
Contributor

Details:

  • update memory_tests runner: check for model metadata, report original model path to

AI Assistance:

  • AI assistance used: no

@culhatsker culhatsker requested a review from a team as a code owner June 15, 2026 11:18
Comment thread tests/memory_tests/tools/run_tests.py Outdated
@dataclass
class TestCase:
model_id: str
model_path: str

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Use path class to store path instead string with native path separator and than replace should be not required.

Comment thread tests/memory_tests/tools/run_tests.py Outdated
device: str

# metadata
original_model_path: str

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Use path class to store path?

Comment thread tests/memory_tests/tools/run_tests.py Outdated
def __init__(self, executable, ir_cache_dirs, devices, api=None, report_reference=False):
self.executable = executable
self.test_name = executable.rsplit("/", 1)[-1].removesuffix(".exe").removeprefix("test_")
self.test_name = executable.replace("\\", "/").rsplit("/", 1)[-1].removesuffix(".exe").removeprefix("test_")

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

instead replace can native path separator be use to split path to parts?

@praasz praasz self-assigned this Jun 19, 2026
@dkrupnov dkrupnov added this pull request to the merge queue Jul 13, 2026
@praasz praasz added this to the 2026.4 milestone Jul 13, 2026
@github-merge-queue github-merge-queue Bot removed this pull request from the merge queue due to failed status checks Jul 13, 2026
@github-actions

Copy link
Copy Markdown
Contributor

CI Doctor — Merge Queue failure on this PR

Pipeline: Windows (VS 2022, Python 3.11, Release)
Failure: Windows CI: CachingTest LoadMulti_race mock call count mismatch and Electron cleanup permission error
Automatic restart: ✅ Re-run of failed jobs requested (reason: both failures are transient — race condition flaky test and Windows file lock during Electron teardown)

Possible remedy

Both failures are unrelated to your PR changes (memory_tests: update reporting):

  1. The re-run of failed jobs has been triggered automatically — this is likely to succeed.
  2. If CachingTest.LoadMulti_race fails again, it is a known intermittent race condition in the Windows CI runner. Re-run the job manually.
  3. If the JS API Electron E2E cleanup fails again, it is due to Windows file locking (electron.exe still running during rm -rf). This is a known infrastructure issue.
  4. No code changes are needed from your side.

What happened

Two independent Windows-only transient failures occurred:

  • C++ unit tests: CachingTest/CachingTest.LoadMulti_race/ByModelName_testCache failed after 171 iterations — the mock import_model was called 7 times instead of the expected 8, a classic race condition in a multithreaded stress test.
  • JS API (22): The Electron E2E test teardown hook failed with Permission denied when attempting rm -rf demo-electron-app-project because Windows still had locks on electron.exe and DLL files.

This is a known recurring pattern for both failure types in the Windows merge-queue CI.

Generated by CI Failure Doctor — Merge Queue · 117.5 AIC · ⌖ 8.85 AIC · ⊞ 17.6K ·

@dkrupnov dkrupnov added this pull request to the merge queue Jul 13, 2026
Merged via the queue into openvinotoolkit:master with commit 654ba6f Jul 13, 2026
210 checks passed
@culhatsker culhatsker deleted the memtest_add_model_source branch July 14, 2026 08:22
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants